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MATRICES ASSOCIATED WITH MOVING 
LEAST-SQUARES APPROXIMATION AND 
CORRESPONDING INEQUALITIES 

SVETOSLAV NENOV AND TSVETELIN TSVETKOV 

Abstract. In this article, some properties of matrices of moving 
least-squares approximation have been proven. The used tech¬ 
nique is based on singular-value decomposition and inequalities 
for singular-values. Some inequalities for the norm of coefhcients- 
vector of the linear approximation have been proven. 


1. Statement 

Let us remind the definition of moving least-squares approximation 
and a basic result. 

Let: 

(1) "D be a bounded domain in 

(2) Xi eV, i = I,... ,171] Xi ^ Xj, if i ^ j. 

(3) / : "D —)■ M be a continuous function. 

(4) Pi : D —)■ M be continuous functions, i = 1,... ,1. The functions 
{pi,... ,pi} are linearly independent in V and let Vi be their 
linear span. 

(5) W : (0, oo) (0, cx)) be a strong positive function. 

Usually the basis in Vi is constructed by monomials. For example: 

pi{x) = . .x^/, where x = (xi,... ,Xd), fci,... /cd G U, fciH -hfcd < 

/ — 1. In the case d = 1, the standard basis is {1, x,..., x^“^}. 

Following n, iiDi, mi, 1121 , we will use the following definition. The 
moving least-squares approximation of order I at a fixed point x is the 
value of p*{x), where p* G Vi is minimizing the least-squares error 

m 

J2^i\\x-Xi\\){p{x) - f{Xi)f 
i=l 

among all p eVi. 

The approximation is “local” if weight function W is fast decreasing 
as its argument tends to infinity and interpolation is achieved if W (0) = 
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oo. So, we define additional function w : [0, cx)) —)• [0, cx)), such taht: 


if (r > 0) or (r = 0 and W{0) < oo), 


w{r) = Vh(r) ’ 

0, if (r = 0 and W{0) = oo). 

Some examples of W{r) and w{r), r > 0: 


W{r) = 

exp-weight, 

W{r) = r-“' 

Shepard weights, 

/ \ 2 _A'^7’^ 

w{x^ Xi) = r e 

McLain weight. 

w{x^ Xi} = e — 1 

see Levin’s works 


Here and below: || ■ || = || • II 2 is 2-norm, || ■ ||i is 1-norm in M“; the 
superscript * denotes transpose of real matrix; I is the identity matrix. 
We introduce the notations: 

f Pi{xi) P2{xi) ■■■ pi{xi)\ / ai\ 


E = 


Pi (*2) ^2(^2) 


PiM 


a = 


0.2 


XPli^Xm) ^^ 2 (^ 771 ) * * ' / \Om/ 



/w{x,xi) 0 

0 

\ 


/Pl(*)\ 

D =2 

0 w{x,X2) ■■■ 

0 


, C = 

P2{x) 


V 0 0 ••• w{x,x^)J \pi{x)J 


Through the article, we assume the following conditions (HI): 
(Hl.l) 1 G Vi. 

(H1.2) 1 < / < m. 

(H1.3) rank(^‘) = 1. 

(HI.4) w is smooth function. 


Theorem 1.1 (see uni). Let the conditions (HI) hold true. 

Then: 

(1) The matrix E^D~^E is non-singular. 

(2) The approximation defined by the moving least-squares method 
is 

m 

i=l 

where 

a = AoC and Aq = D-^E {E^D-^E)~\ ( 2 ) 
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(3) If w{\\xi — Xi\\) = 0 for alii = 1,... ,m, then the approximation 
is interpoiatory. 


For the approximation order of moving least-squares approximation 
(see [10] and 0 ) it is not difficult to receive (for convenience we suppose 
d = 1 and standard polynomial basis, see 0): 






Z=1 


(3) 


and moreover ((7=const.) 

\\f{x) -p*(x)||oo < C'/i'+^max{|/('+^)(x)| : x e V} . (4) 

It follows from (]3|) and (01) that the error of moving least-squares ap¬ 
proximation is upper-bounded from the 2-norm of coefficients of ap¬ 
proximation (||a-||i < \/m||a|| 2 ). That is why, the goal in this short 
note, is to discuss a method for majorization in the form 


||a ||2 < Mexp (A^||a; - cCjH), 

Here the constants M and N depends on singular values of matrix 
and numbers m and I (see Section 3). In Section 2 some properties 
of matrices associated with approximation (symmetry, positive semi- 
dehniteness, and norm majorization by (Tmin{.E^) and (Tmax{.E^)) are 
proven. 

The main result in Section 3 is formulated in the case of exp-moving 
least-squares approximation, but it is not hard to receive analogous 
results in the different cases: Backus-Gilbert wight functions, McLain 
wight functions, etc. 


2. Some Auxiliary Lemmas 
Definition 2.1. We will call the matrices 

Ai = AqA* = D-^E {E^D-^E) A* and A 2 = Ai - I 
Ai-matrix and A 2 -matrix of the approximation L, respectively. 


Lemma 2.1. Let the conditions (HI) hold true. 
Then, the matrices AiD~^ and A 2 D~^ are symmetric. 


Proof. Direct calculation of the corresponding transpose matrices. □ 


Lemma 2.2. Let the conditions (HI) hold true. 
Then: 
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(1) All eigenvalues of Ai are 1 and 0 with geometric multiplicity I 
and m — I, respectively. 

(2) All eigenvalues of A 2 are 0 and -1 with geometric multiplicity I 
and m — I, respectively 

Proof. Part 1. We will prove that the dimension of the null-space 
dim (null {A 2 )) is at least 1. 

Using the dehnition of A 2 = D~^E {E^D~^E) ^ E* — I, we receive 
E^A2 = (E^D-^E) {E^D-^E)~^ E^ - E* = 0. 

Hence 

im (H 2 ) C null {E^). 

Using (HI.3), E^ is (/ x m)-matrix with maximal rank I {I < m). 
Therefore dim(null (U*)) = m — 1. Moreover dim(im(y 42 )) = m — 
dim (null (H 2 )). That is why m — dim (null (H 2 )) < m — I or I < 
dim (null (^ 2 ))- 

Part 2. We will prove that —1 is eigenvalue of A 2 with geometric 
multiplicity m — I, or the system 

H 2 T 7 = —T] Hi 77 = 0 

has m — I linearly independent solutions. 

Obviously the systems 

Hi77 = D-^E {E^D-^E)~^ E^rf = 0 

and 

E^r] = 0 

are equivalent. Indeed, if r/g is a solution of ([5]), then 
D-^E {E^D-^E)~^ E^rfQ = 0 ^ E^p-^E {E^D-^E)~^ E% = 0 

^ E^Po = 0 > 

i.e. 77o is solution of (jb]). 

On the other hand, if tJq is a solution of ([ 6 ]), then 


(5) 

( 6 ) 


D-^E (E^D-^E) E^j rjo = \^D-^E [E^D'^E) j [E^'n^) = 0, 

i.e. 77 q is solution of (E]). Therefore 

dim (im (Hi)) = dim (im (i?*)) = m — 1. 

Part 3. It follows from parts 1 and 2 of the proof that 0 is an 
eigenvalue of H 2 with multiplicity exactly / and —1 is an eigenvalue of 
H 2 with multiplicity exactly m — 1. 
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It remains to prove that 1 is eigenvalue of Ai with multiplicity at 
least I, but this is analogous to the proven part 1 or it follows dirctly 
from the dehnition of = TI 2 + /. □ 

The following two results are proven in na. 


Theorem 2.1 (see [13], Theorem 2.2). Suppose U, V are (m x m) 
Hermitian matrices and either U or V is positive semi-dehnite. Let 

Xi{u) >■> XUU), Ai(y) > • • • > XUV) 

denote the eigenvalues of U and V, respectively. 

Let: 

(1) vr([/) is the number of positive eigenvalues ofU; 

(2) z/(t/) is the nubver of negative eigenvalues of U; 

(3) ^(U) is the number of zero eigenvalues of U. 

Then: 

(1) If 1 < k < 7r{U), then 

min {X,{U)Xk+i-i{V)} > Xu{VU) > max {A,([/)A^+fc_,(l/)} . 


(2) If 7i{U) < k < m — viU), then 

Xk{VU) = 0. 

(3) If m — I'iU) < k < m, then 

min {A,(f/)A™+,_fc(f")} > Xk{VU) > max {Xi{U)K+i.k{V)} . 


Corollary 2.1 (see [13], Corollary 2.4). Suppose U, V are {m x m) 
Hermitian positive dehnite matrices. 

Then for any 1 < k < m 

Ai(17)Ai(y) > Xk{VU) > XUU)XUV). 

As a result of Lemma 12.11 Lemma 12.21 and Theorem 12.11 we may 
prove the following lemma. 


Lemma 2.3. Let the conditions (HI) hold true. 

(1) Then AiD~^ and —A 2 D~^ are symmetric positive semi-dehnite 
matrices. 

(2) The following inequality hods true 


Amax(^l-D ) < 


Amin(-D) 
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Proof. (1) We apply Theorem 12.11 where 

U = D, V = AiD-\ 

Obviously, U is a. symmetric positive dehnite matrix (in fact it is a 
diagonal matrix). Moreover 7 r([/) = m, /i(t/) = ^{U) = 0, if a:: 7 ^ a:*, 
i = 1 ,..., m. 

The matrix V is symmetric, see Lemma 12.11 

From the cited theorem, for any index k {k = 1,... ,m = 7r(17)) we 
have 

Xk{A,) = Xk{A^D-^D) = Xk{VU) < min {A,(f/)A™+,_fc(l")}. 

l<i<k 

In particular, if A; = m: 

Xm{Ai) < min {Ai([/)Ai(y)} . (7) 

l<i<m 

Let us suppose that there exists index io (io = 1,..., m — 1) such 
that 


Ai(y) > • • ■ > Ai„(y) > 0 > A,„+i(l") > • • • > X^(V). (8) 


It fowollws from ([H]) and positive dehniteness of U, that 


min {Ai(f/)Aj(I/)} 

< -^io+l 

l<2<m 


< 0. 


Therefore (see (I7j)) Am(^i) < 0. This contradiction (see Lemma [22D 
proves that the matrix AiD~^ is positive semi-dehnite. 

If we set U = D, V = —A 2 D~^ then by analogical arguments, we 
see that the matrix —A 2 D~^ is positive semi-dehnite. 


(2) From the hrst statement of Lemma [2.31 V = AiD ^ is positive 
semi-dehnite. Therefore (see Corollary 12.11 and Lemma [2.2p : 

1 > Xk{A,) = Xk{VU) > max{XUU)Xk{V),XUV)Xk{U)} 

for all k = l,...,m. Moreover all numbers Xk{U), Xk{V) are non¬ 
negative and 


'^max(-^) 

Therefore 

or 


Ai(17) > • • ■ > XUU) = X^UD), Ai(C) > • 


1 >max{A^([/)Ai(I/),A^(C)Ai(17)} 


A^ax(AliZl-') = Ai(I/) < 


Xm{U) XmmjD) 


> Xm{V). 


□ 


In the following, we will need some results related to inequalities for 
singular values. So, we will list some necessary inequalities in the next 
lemma. 
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Lemma 2.4 (see |19] . 0). Let U be an {di x d2)-niatrix, V be an 

(^3 X d4)-matrix. 

Then: 


^max (UV)< 

^max (U) ^max 
1 


(9) 

if di = d 2 , det U ^ b, (10) 


<Tmax(t^ ) /7-r\’ 

<Tmax(V")(7min(t^) < CF^^^{UV), if di > d2 = ^3, (H) 

(7max(t/)crmin(^) < (^ms.y,{UV), if d^ > ds = ^2, (12) 


If di = d2 and U is Hermitian matrix, then 
|Ai([/)|, i = l,...,di. 


= 0'max(t/), (yi{U) = 


Lemma 2.5. Let the conditions (HI) hold true and let x ^ Xi, 
i = 1,... ,m. 

Then: 

l|TD-‘|| < ^-Ut, (13) 


A„i.(r>)’ 

^max (dll) ^min {D ) < (Jmax(^l-D ), 


1 < Pill < 


<7max(-D) 

CTminiD) 


(14) 

(15) 


Proof. The matrix AiD ^ is simmetric and positive semi-definite (see 
Lemma [231(1) )• Using the second statement of Lemma 12731 and Lemma 
[231 we receive 

\\A,D-^\\ = a^^,{A,D-^) = A^ax ^ 


Amin(-f^) 


The inequality f[TT)) follows from flT^ {d^ = d^ = m) 
From flTT]) and firU)) . we receive 

( A \ <^ ^max {A,D-^) 

^max (D) 

<TmaxiaiJ S ^ ■ 

O-miniD ^) Crmin(-D) 


Therefore the equality ||Ali|| = a m^A Aff) implies the right inequality 

in (n3]) . 

Using = E^Ai and inequality ([2]), we receive 

<7max(-E' ) ^ CT max {E^)a 

max (P), 

or 1 < crmax(^i) = Pi|P, he. the left inequality in flTHl) . 

The lemma has been proved. □ 
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3. An Inequality eor the Norm oe Approximation 

Coefficients 

We will use the following hypotheses: 

H2.1. The hypotheses (HI) hold true. 

H2.2. d = 1, xi < ■ • • < Xm- 

H2.3. The map c is C^-smooth in [xi,Xm\- 

H2.4. w{\x — Xi\) = exp(Q:(a; — i = 1,... ,m. 


Theorem 3.1. Let the following conditions hold true: 

(1) Hypotheses (H2). 

(2) Let X G [xi,Xm] be a fixed point. 

(3) The index /cq ^ {1, • • •, Ri} A choosen such taht 

\x — Xko\ = min{|a; — Xi\ : i = 1,..., m}. 
Then, there exist constants Mi , M 2 > 0 such that 


a'(2^)|| < ( ||a(a^fco)ll + Mi|a; - ) exp (M 2 I X — XkQ I) 


Proof. Part 1. Let 

f2a{x — Ti) 0 

0 2q;(x — X2 ) 


H = 


then 


V 0 

dD 


0 


0 \ 
0 


2a(x - Xm)/ 


— = HD, = -HD-\ 

dx dx 


We have (obviously D = D{x), H = H{x), and c = c(a;)) 
da{x) d 


dx dx 


D-^E {E^D-^E) 


= ^ TT-T)-‘ c + d-t (T 

+ D-^E (E^D-^E)~^ 

= - HD-^E (E^D-^E)~^ c 

+ D-^E (E^D-^E)~^ (^-^E*D-^E^ (E^D-^E) 

+ D-^E (E^D-^E)~^ 


-1 
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= - Ha 


+ D-^E {E^D-^E) ^ {E^HD-^E) {E^D-^E) ^ c 
+ D-^E {E^D-^E)~^ 

(LJb 

= (p-^E {E^D-^EY^ E^ - j) Ha 

+ D-^E (E^D-^EY^ —c 
^ ax 

=A2Ha -\- Aq——c. 

ax 

Therefore, the function a{x) satishes the differential equation 


da{x) 

dx 


A2Ha + Af) 


d_ 

dx 


(16) 


Part 2. Obviously 


\\A2H\\ = \\{A,-I)H\\<{\\A,\\ + 1)\\H\ 
It follows from flT5|l that 


Pill < 


<Tmax(f^) 


Here crmax(-D) < 2exp(a;r^), r = Xm — Xi, and cTmin(-D) > 2. Hence 

pill < Y exp(ar2). 

For the norm of diagonal matrix FT, we receive 

llhfll < 2ar. 


Therefore ||H 2 -H|| < M 2 , where 

M 2 = 2ar + y/exp(m^j . 

We will use Lemma 12.41 to obtain the norm of Hq. 

Obviously AqE^ = Ai. Therefore by flT^ {m = d^ > d^ = 1) we have 

^max (A) ^min {E^)< 

^max Pi), 


i.e. 


poll < 


Therefore, if we set Mu = 


1 / ll"max(-hl) 

^min V ' ^min (P‘ 

Mo 

-then IIHoII < Mi. 

(Train[E^) 
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Let the constant M 12 is choosen such that 
d , 


dx 


c(x 


< Mi2, Xe[xi,Xm\ 


and let Mi = M 11 M 12 . 

Part 3. On the end, we have only to apply Lemma 4.1 form [7] to 
the equation fITB]) : 


/ 

X 

A d 
Ao-^c 
dx 


\ 


X 

n 

ll«(a:^fco)ll + 

/ 

dx 


exp 

/ \\A2H\\dx 

V 

Xko 




J 

XkQ 


< (||a(a;fcj|| + Mi\x - x^oDexp (M2IX - . □ 


Remark 3.1. Let the hypotheses (H2) hold true and let moreover 
Pl(x) = 1, P 2 (x) = X, . . . , pi{x) = x'"\ I > 1. 

In such a case, we may replace the differentiation of vector-fuction 



/pi(x)\ 


( 1 \ 


P2{x) 


X 

c(x) = 





by left-multiplication: 


dc{x) 

dx 





0 

0 .. 

0 

0 


1 


1 

0 

0 .. 

0 

0 

0 

2x 


0 

2 

0 .. 

0 

0 

0 

3x^ 

= 

0 

0 

3 .. 

0 

0 

0 

(/ — 2)x*“^ 


0 

0 

0 .. 

. 1-2 

0 

0 

\(/ — i)x^“^y 


VO 

0 

0 .. 

0 

1-1 

0/ 


dc{x). 


( 1 \ 

X 

x^ 


xl 2 
\X^“^/ 


The singular values of the matrix d are: 0,1,..., / — 1. Therefore 

nail = vr^. 

That is why, we may chose 


M 22 = \/{l -1) max < max \pi{x)\ 

l<i<l \x\<X<Xm 

Additionally, if we supose |xi| < |xm|, then 

max \pi{x)\ = \pi{xm)\, i = l,...,/. 

Xl<X<Xm 
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Therefore, in such a case: 

M22 = V'(/ - 1) max {\pi{xm)\} ■ 

l<i<l 

If we suppose —l<Xi<x<Xm<^, then obviously, we may set 

M22 — ~ 1 - 
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